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I. Introduction: 

This report has been written to pull together relevant data and 
to provide some interpretation so that this project's staff and other 
interested parties can profit more from resources which have been 
expended during the current year. The format for this report is 
similar to that used in the previous annual report, which is avail- 
able from the Education Resources Information Center (ERIC) under 
the designation of ED 054 069. These t-o reports were written to 
be used independently, but there is a substantial amount of infoi:- 
mation in the previous report which is not covered here. A third 
and final report will be published at the end of the 1972-1973 
school year when this project is terminated under the current Edu- 
cation Professions Development Act (EPDA) grant. 

Three major goals were written into the original proposal, and 
a fourth was added to encompass the scope of the project. Several 
objectives were written to delinate more fully desired results from 
the project. Those objectives were divided into two categories 
(project objectives and performance objectives) at '.he request of 
the Institutional for Education Development (lED), which was making 
an evaluation of several Bureau of Education Professions Development 
(BEPD) projects during fiscal year 1971. The project objectives 
were used primarily for the orientation of laboratory school master 
teachers to desired training outcomes in various classrooms which 
make up the practicum setting for the project. (They are published 
in appendix T of this report.) The performance objectives were used 
to evaluate the effectiveness of project efforts in bringing about 
desired results by the total project. (They are published in the con- 
text of data "On Trainees" in appendix A of this report.) The four 
major goals of '•he project will be presented here in the context of 
a brief statement of respective educational needs. 



A. 



Goal 1; To retrain experienced teachers and train auxiliary 
educational aides to assist handicapped children and educationally 
impoverished children to reach a higher level of learning potential 



Ln the regular classroom. , . 

4eed: Better preparation of teachers to meet the individual needs 

3 f children has always been a laudable goal. However, traditionally 
teachers have been best prepared to teach the hypothetically average 
child. This prompted the development of an array of supportive and 
often separate services to meet the needs of special children. These 
children became known for their differences, rather than the thinp 
which they had in common with other children. Now for better social- 
ization of all children, and other reasons, it has become more desirable 
that the needs of children should be met as much as possible within the 
regular classrooms by the regular teacher. For this expecially de- 
manding role, teachers need additional training and the support of other 
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personnel. Educational aides can be of great assistance to the 
teacher in fulfilling that role, particularly when they are trained 
concurrently with the teacher. 

B. Goal 2: To use the team approach as a positive force for the 

development of skills and understandings of human relationships 
requisite to effective participation in a team enterprise with 
division of labor and limits of autonomy identified for each 
participating member. 

Need ; Teachers have traditionally been trained to function singly 
without considering the skills requisite for wo'^king in teams. 

In order to use aides effectively, and draw on other resources 
desirable for promoting learning (especially for teaching handi- 
capped children), teachers must be assisted in the development 
of skills required for team work. Likewise, aides must acquire 
the skill of playing different roles within the team as various 
situations may require. Opportunities for team interaction and 
training for both f eachers and aides currently occur primarily 
on the job where consultation and flexibility are very limited. 

C. Goal 3: To affect change in the teacher-education program by 

providing multiple opportunities for early entry as well as 
conventional entry to training experiences in pre-kindergarten 
through sixth grade programs to know, to be aware, and to become 
more sensitive to the handicapping conditions to learning. 

Need: The acceptance of the needs listed above indicates a need ^ 

for the revision of teacher education programs. The potential of 
various methods of observation, study, and practicum participation 
in classrooms to provide realism and relevance in learning is a 
resource which is largely untapped and should be more fully in- 
vestigated for use in preparation of people seeking positions in 
educational professions. If EPDA projects are to have a significant 
impact the results of these endeavors must become an integral 
part of educational institutions. Only in this way can any long 
range effectiveness in meeting the needs listed above be obtained. 

D. Goal 4: To involve agencies from the community in the educative 

process for the enhancement of learning for all children, and for 
facilitation of constructive interaction between schools and 

Need ; Data from studies such as the Coleman report have indicated 
IhlT factors other than those found in schools are of critical im- 
portance in promoting learning by children. Yet, school personnel 
are usually uncomfortable working with parents and agencies outside 
of the school. Therefore, efforts are necessary to prepare teachers 
and other school personnel to work with agencies outside of the 
schools, and to help those agencies be more compatible with and 
supportive of school programs, so that children will stay in school 
for an optimum learning experience . 



II. Operation of the Program: 



A. Planning: 



Time Periods 
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Time line points of reference 



Much of the ground-work for the time covered by the current 
grant (fiscal years 1971, 1972, and 1973) was laid during an initial 
one year grant for fiscal year 1970. Facilities used and the mode of 
training, through an interaction of seminar and practicum experiences 
at the U.S.U. Edith Bowen Laboratory School, have remained basically 
the same. Three of the underlying goals have also remained the same. 
However, there have been some significant changes in staff makeup and 
scope of project orientation. Each of these will be considered in 
terms of the above time line in the discussion which follows. 

Plans for the proposal, which was eventually funded to cover 
the current grant period, were initiated during the summer of 1969 
(point 1 on the cime line above). The person who is currently 
serving as project director was selected at approximately point 
three on the time line above to serve for the grant period. She 
began to play a major role in project activities, in addition to 
her other full time university responsibilities in the spring of 
1970 (point 4 above). The most significant of these project acti- 
vities was the making of visits, with the director of the laboratory 
school, to all of the districts which were to send participants to 
the project for training. These visits were made to confer with top 
level district administrators in the development of cooperative 
arrangements that were to be used throughout their involvement with 
the project, and particularly to outline guideline!? for the recruiting 
of participants who would receive training at the project (emphasizing 
that preference should be given to individuals from minority and low 
income groups). These activities were essential in cementing re- 
lationships and stimulating the involvement of minorities, but they 
had to be accomplished before time or funds could be provided through 
the grant under which the staff was to work. 
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A major shift in orientation was presented to EPDA Project 
leaders at a Kanras City conference in the late fall of 1970 
(point 6 on the tins line). At that time instructions were 
given to the direccors of this project to incorporate plans for 
promoting institutional change and community involvement into 
the plan of operation which was to be submitted for fiscal year 
1972. It was nine days (November 25, to December 4, which in- 
cluded the Thanksgiving weekend) from the time the director 
arrived back on campus to the day on which the plan of operation 
was to be mailed. This left insufficient time for any meaningful type 
of involvement with community or institutional representatives. An 
additional major goal (number four as cited in the introduction) and 
objectives written into the plan of operation all had to be formu- 
lated intellectually on the basis of reasonable possibilities which 
'were desirable from the point of view of project philosophy. A 
half-time "community coordinator" was added to the staff to aid in 
expanding the project's role in the community. He did an outstanding 
job of involving parents (see appendix A, "Impact on Institutions" and 
appendix P) , but • he Influence and talents of any one person would 
not extend across the entire area where institutional change might 
be promoted. 

Shortly after the reorientation to focus on institutional 
change and community involvement had occured, another reorientation 
began to take shape (as is apparent with the benefit of hindsight). 

In the early spring of 1971, (point 8 on the time line) at least 
three impressive letters, from different sources, requesting in- 
formation on whether and what kinds of tools or products had been 
developed through the project were received and answered with 
samples. It should not have come with much surprise that in 
September, 1971, (point 10 on the time line) shortly after the 
year covered by this report began, development of products was to 
be a new priority. Guidelines for the plan operation for fiscal 
year 1973, to be sub»^i.ted by October 1, 1971, Included a major 
emphasis on production of "instructional units." Even though those 
guidelines were directed at fiscal year 1973, planning and primary 
development of those materials had to occur this year if they were to 
be ready for testing and refinement during the final year (FY 1973) 
of the project. This shift took a great deal of attention off of the 
orientation which was coined two years ago for implementation during 
the past year. The shift to product development was undoubtedly in 
keeping with the Interests of the Bureau of Education Personnel 
Development (BEPD), but it made criterion established for evaluation 
less appropriate. 



Recommendations as to how planning could have been more effective 
must be couched in terms of what type of program was to be Implemented - 
(1) training, (2) institutional change, or (3) the development of 
materials. The project was involved in all three during the period 
covered by this report. Whenever training is the central concern, re- 
leased time is essential for recruiting of trainees and the laying of 
plans with administrators where trainees will be employed after thej’ 
complete their training. This activity should begin at least one year 
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before training begins, in order to (1) give prospective trainees 
an opportunity to set appropriate expectations about the type of 
training they will receive, and (2) insure administrative support 
is given to those people when they have completed training. Follow- 
up support and monitoring of trainee utilization of preparation 
should continue for at least one year after they have been re- 
employed in naturalistic settings. 

Whenever institutional change and community involvement 
are the central concern, adequate time must be alloted so that 
prominent people in those social systems can be involved in the 
planning phase. Generally, only one c a selected few (commen- 
surate with project resources) of the infinite number of selectable 
institutions or communities should be looked upon as targets in 
which to implement change. This is particularly true if an account- 
ability model of meeting criterion specified in objectives is to be 
engineered. Unless there is some way of getting involvement (e.g. 
control over reInforcers, activities of interest to, or leadership 
respected by members of the target institution or community) there 
is little likelihood that change will be effected. Fortunately, 
the project director and staff of this project had considerable 
prominence in professional organizations in the state and were able 
to influence many of the factors to which professionals in the state 
were exposed. However, the net effect of this influence is only just 
beginning to emerge (see appendix A, "Impact on Institutions ) . 

Whenever development of materials is the central concern, 
there must be an explicit understanding of what is entailed. As 
was learned from Walter Borg and others at the EPDA materials 
conference in Washington, the type of knowledge and expertise re- 
quired to package materials is not abundantly available. The time 
lapse between conceptualization in a communicable form (which is 
the most creative and knotty problem) to production in an operational 
form for disser”' nation is almost certainly greater than one year. 

(Other aspects of planning for materials development will be discussed 
below under Dissemination.) 

B. Participants and Staff (see appendixes I & J for names): 

Districts involved were intentional selected because of the 
relative high incidences of minority group children in their schools. 
Areas represented vary from rural remote to the core of the second 
largest city in the state. It is becoming increasingly apparent that 
having a concentration of trainees from a particular area with common 
experiences is important in the implementation of project preparation. 
\^ether this caused trainees to be more likely to use their training 
or whether it is symptomatic of administrative support given to utili- 
zation of preparation is not as yet discernable, buc it is evident that 
where trainees have an opportunity to interact after employment their 
morale and enthusiasm for project training remains higher. 
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Selectlon of trainees was made by administrative personnel 
in participating districts where they were to be hired in order 
to insure more fully the utilization of their training at com- 
pletion* With the current difficulty encountered by many teachers 
in getting jobs and the uncertain employment prospects for aides 
(see appendix A, "Impact on Trainees," Objective #8 for amplifi- 
cation), this has proven to be a very desirable procedure* As was 
noted under A above, administrators in the various districts were 
given criteria to follow in selecting personnel* Most Important 
of these beyond commitment to employ those sent was that representa- 
tives from minority or low Income groups be given priority in 
recruiting* Unfortunately, certified people f^'jm minority groups 
from all the districts were not available to fill the sixteen 
teacher positions; however, six of the sixteen aides (37*5%) did 
represent minority groups* (That is considerably better than the 
10% minority representation in the district involved which has the 
highest incidence of minority population*) 

Getting minority representation among the trainees and staff 
is becoming increasingly difficult* "Affirmitive action" policies 
on university campuses, teacher corps, and other federal programs 
have increased competition in attracting minority group members* 
Availability of minorities with high school diplomas or less is 
still fairly good, but their employment as aides has become less 
likely as school district budgets have become hard pressed* 

C* Program Operation: 

The training program continued in a format similar to that 
used in previous years* Practicum experiences occurred in the 
laboratory school classrooms (where handicapped children are Inte-* 
grated) each morning from eight to twelve* Seminars (see appendix 
U for topics) were designed to the needs and Interests of partici- 
pants and were held £ro^ one to three on Monday, Tuesday, Thursday 
and Friday afternoons* Each Wednesday from one to four, the teams 
(master teacher, certified teacher from a participating district, 
student teacher(s), and paraprofesslonal aide from a participating 
district), which worked together in practicum during mornings in 
each classroom met to staff and plan for the needs of children* 

During previous years, university staff from the departments of 
elementary an^ special education had been assigned to meet with 
each team* This process was discontinued to create more realism 
for participants, who would not have professors available on a regu- 
lar basis in home situations* The program as outlined in the proposal, 
and described above was fully Implemented* All trainees stayed for 
the scheduled duration of their training* The year was noteworthy 
because there was seldom an atmosphere of crisis because of any of 
the participants* 




10 









7 



1 



I 



- 7 - 




Evidence indicated that satisfactory progress is being made 
toward goals 1 (preparing teachers and aides to work with handi- 
capped children), 2 (preparing personnel to work in teams), and 
3 (making changes in the teacher education program.) Progress on 
number 4, (community interaction with the schools) is less clear 
beyond the extent to which parents have been involved. Commendable 
efforts have been made at becoming involved with mental health and 
migrant council activities, but effectiveness of those activities 
as yet is not clear. 

D. Dissemination: 

Appendixes B,C,D,E,F, and L are samples of tools or ex- 
planations about tools that have proven useful in evaluation at 
the project setting. Other materials were reported in appendixes 
B through G and R of the previous annual report (available under the 
ERIC designation of ED 054 069) or are in development for dissemi- 
nation next year. 

Appendixes B,C,D, and E in this report are most appropriate 
for the evaluation of the impact on trainees of programs in which 
participants are involved directly with children in regular class- 
room settings. Appendix F in this report is of primary value for 
instruction and record keeping about the characteristics of children. 

It is also useful in evaluating the impact of a program on children. 

Appendix L is most appropriate for evaluating and studying the self 
concepts of pre-school to adolescent children. 

The materials published in the previous annual report would 
probably be of most interest to classroom teachers of elementary 
school children. Topics of those materials were: 

1. Kindergarten perceptual — Motor Activities 

2. A Stuf* of Self-Concept and Human Relationships with Six- 
Seven - and Eight - year olds (to enhance self-concept and 
social adjustment of children 

3. In Mathematics (adapting instruction to the child) 

4. Creative Expression (facilitation of expression for classrooms 
of children with wide ranges of ability) 

5. Evaluation of an Audio- Tutorial Proceedure with Math Deficient 
Fifth Graders, and 

6. A tool for assessing Basic Reading Skills and Concepts. 

One of the basic questions that must be answered in any dissemination 
process is, 'why would someone want to use this material'? Regardless 
of how altruistic one might think people are, the evidence seems to indi- 
cate that unless some sort of an incentive is provided, new materials 
will seldom leave the shelf. The Far West Laboratories Minicourses, 
involving one of the most rigourously tested packaging systems, con- 
stitute a case in point. An evaluation of reasons for their use (which 
the author made for U.S.U.) indicated that the primary reason for ex- 
pending the extra energy to expose oneself to the micro- teaching proceedures 
was to receive university credit in order to be placed higher on the 
salary schedule. Another reason was to get credit for recertification to 
continue employment as a teacher. Tools like these may be very useful 
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and/or effective, but unless the user has felt a need (either 
attracted to or forced to) to expend the energy to learn and 
implement the new systems, it probably will not be used. If this 
is true, we roust consider the ethics of advertising products and 
creating and/or tieing in to incentive systems. 

An alternative to this is to place people in a learning 
(laboratory) situation where the tool is being used, have them 
see it being used, use it themselves, and have the option of 
adopting it into their permanent repertoire (perceiving, be~ 
having, becoming). 

E. Evaluation (see appendix A for an amplification): 

1. Impact on Children: 

Standardized Instruments were used to gather self“concept and 
achievement data on children at the laboratory school. This data 
can be used, not so much to evaluate the effectiveness of the train- 
ing, as to monitor the Impact of a training program on children who 
reside at the training setting. Inferences as to the capacity trainees 
have gained at the project to work with children can best be made from 
data gathered on children when trainees are employed in naturalistic 
settings (some favorable evidence of that type is provided in appendix G). 

Self-report and teacher rating data from which to infer self- 
concept were gathered at the beginning and end of the academic year. 
Evidence of enhanced levels of self-concept were found concurrently on 
both measures for both special* and typical children. Findings of 
moderately high test - retest reliability on both measures and moderately 
high interrater reliability on teacher ratings were Interpreted as con- 
tributors to the first substantial evidences of concurrent validity 
ever found by the author in his studies or in published literature. 

This evidence Indicate^ desirable t 5 rpes of impact on children by the 
project, but in the long run the demonstration that paper and pencil 
self-concept measures can be shown to have some validity may be more 
significant. 

Metropolitan Achievement Tests (MAT) have been used to gather 
data each spring during the past four years at the laboratory school 
to monitor achievement progress of special and typical children. The 
data, when looked at from the context of the past year or progress 
over a series of years, indicate that typical children show comparable 
or increased progress with each year in spite of many shortcomings in- 
herent in the standardized test approach to data gathering. MAT data 
also can be interpreted to indicate that special children do not perform 



*Children from learning adjustment classes for the emotionally dis- 
turbed have been Integrated into the regular classroom since the 
project's inception. Only one child has been returned to a self 
contained learning adjustment classroom. (That was done because the 
continuous Involvement of university students in all classrooms 
provided an insurmountable degree of distraction for the child.) 
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significantly better in succeeding testing until they master some 

of the phenomena associated with reading. The firmest conclusions 

that could be made about using standardized tests with special 

children was that it was a negative experience for them and the 

results were not very meaningful. Anecdotal evidence and parent responses 

were encouraging and a much more useful tool than test data both in 

planning programs for children and making critical evaluations. 

2. Impact on Trainees; 

Several psychometric measures were used on a quarterly basis 
to measure attitudes. Assessment on l-ss than a semester basis 
did not indicate significant changes within the group. Small group 
conferences and behavior check list ratings on a monthly basis were 
most useful in providing a forum for dialogue and interaction with 
trainees. Behavior checklists were used in the practicum setting by 
master tochers, and small group discussions were held during seminar 
periods^ Both i;he conference and checklist formats offered an oppor- 
tunity for staff to indicate the direction of desired change and for 
the trainees to give feedback on how they felt things were moving. 

Posttest minus pretest data gleaned from trainees during each eighteen - 
week training period indicated the following; 

a. Enthusiasm for major themes emphasized during the training 
period remained high. A significant increase in enthusiasm 
was measured in attitudes toward "educating exceptional child- 
ren in regular classrooms" and "community control of the schools." 

b. Self-concept assessment indicated that there were no significant 
changes on the level of self-concept of trainees as a group, but 
fluxuation within scores of individuals revealed that a great deal 
of self-examination and reality orientation had occurred during 
the training period. 

c. Attitude assessment with the Minnesota Teacher Attitude Inventory, 

(A measure of attitudes empirically determined to be conducive 

to "harmonious relations" in the classroom) revealed significantly 
improved attitudes in all groups. 

d. Behavior checklists used to assess student centeredness , as a 
measure of individualization, indicated significant progress on a 
monthly basis while at the project, and follow-up into districts 
after trainee employment indicated that regression had not occurred 
below the eighty percent criterion that had been established in 
objectives. 

e. Teacher and aide groups did not attain statistically significant gains 
on a test to tap their general knowledge of special education concepts. 

f. The employment rate of teachers after completion of training was 

at or above the ninety percent criterion established in objectives. 

The employment rate of aides in various groups was approximately 
eighty percent. The extent to which trainees, especially aides, 
were able to use their preparation after completion of training, was 
largely a function of committments made by administrators in districts 
from which they came. (Return on questionaires mailed to Past 
participants was approximately fifty percent on the first mailing. 

A followup certified letter raised the to about ninety percent.) 
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The most important contributor to the attainments noted above 
is without a doubt the setting afforded by the university laboratory 
school and the teachers therein who supervised the practlcum and 
staffing activities for participants. The setting afforded the 
cpporunity for elements from the university, particularly the College 
of Education* to be blended with children. Intellectual contributions 
tended to taice on more meaning when they were translated by the reality 
that was provided by children. 

The informal seminars which occurred on four afternoons each 
week were another factor which was essential to participant training. 

Topics (see appendix U) and formats that invol" ed participants were 
determined in curriculum planning meetings. In this way participants 
had some control over and responsibility for their program. One of 
the most important components of the seminar activities was the weeks 
devoted to the study of minority cultures. This was of special im- 
portance in Utah and to Cache Valley in particular, where many people 
have not associated with people from minority groups. People such 
as Julian Bond, brought in by the university, served to complement the 
program which the project sought to provide for participants. These 
activities confronted participants and staff with some very challenging 
experiences. Experiences shared at the project by participants and 
staff served in many cases to cement relationships that will last for 
a lifetime. 

Follow-up visits with trainees to where they are or are to be 
employed will continue at least through the next year when the grant 
period ends. Situations in which they work vary greatly, making com- 
parative evaluations of effectiveness impossible. However, it is 
encouraging that trainees are given the responsibility for a dis- 
propor tionally large share of title I or other types of disadvantaged 
children. Visits during the next year will be used primarily to give 
support and to test instructional packages which are being developed 
at the present time, 

3, Impact on Institutions: 

Evidence of a program's Impact on any institution is not likely 
to be forthcoming in a short period of time. If this were not so, 
our society would be unstable. In view of this, it seems appropriate 
that some of the evidence reported here should be in terms of information 
which has been Introduced to bring change about and that indications of 
change should be expected only in preliminary forms. 

a. The most concrete changes have occurred within the Department 
of Elementary Education. Those are: (1) earlier and more 

meaningful involvement with children by university students, 

(2) the development and dissemination of instructional materials 
by laboratory school staff, and (3) the implementation of a new 
teacher education model which should provide more Individualization 
for prospective teachers. 





11 - 



b# The process approach Iraplemented in the project has gained 
some recognition within the university community on the 
strength of the national recognition it has received; however, 
the extent of project influence in the university context 
still leaves much to be desired* 

c. Orientation programs given in public school districts 

and at the laboratory school site have been well received, 
and have promoted a climate in those districts in which 
trainees have generally been able to implement new 
approaches. The climate is no-- conducive to further in- 
volvement and productivity. 

d. The appearance of several prominent figures has promoted 
community causes consistent wi th project objectives • The 
.most notable result of these is the extent to which parents 
are beirg involved in child study groups at the laboratory 
school and other schools within the community. 

e. Project and laboratory school staff have been influential 
in professional organizations in the state. Their status 

in that regard is increasing, and they are serving to promote 
inter-institutional programs up to and including the university 
level. 

f. Impact on other federal programs is growing with project 
prominence. Attendance by project staff at several national 
invitational conferences on future developments in education 
are indicative of the project’s status on that level. Hope- 
fully, inputs into the ABT associates evaluation of the thirteen 
exemplary EPDA programs in the nation will also be instrumental 
in promoting constructive change in future educational processes. 
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III. Appendixes: 



APPENDIX A 

Research and Evaluation 



This appendix will be used to present and conunent upon data 
which were drawn during this the second year of a three-year ex- 
tension to a project Implemented to explore ways of preparing 
personnel to work with handicapped chi'dren In the regular class- 
room. In most cases comparable types of data were drawn during 
the preceding year. That Information has been cited in a previous 
annual report which is available under the ERIC designation of 
ED 054 069. 

In the first section of this appendix (Impact on Children), 
data are presented separately to indicate the progress of handicapped 
and more typical children respectively, even though the two groups 
remained Integrated in the same classroom. Separate analysis 
serves to emphasize difficulties encountered in using standardized 
Instruments with handicapped children, and illustrates differences 
reflected by the two groups. 

The second section (Impact on Trainees), as in the previous report, 
focuses on psychometric results attributable to project effectiveness. 
Inasmuch as the performance objectives specified in the plan of operation 
were oriented to this area of concern, they will be used as an outline 
for the section. Data are presented in respect to each performance 
objective in turn, and some additional data are presented to illustrate 
results not specifically covered by objectives. 

The third '•ection (Impact on Institutions) is used to cite evi- 
dence of institutional change. This evidence is more qualitative in 
nature and less amenable to rigorous statistical analysis but in the 
long run may be of greater practical significance. The major emphasis 
is placed on the aspects of institutional change in the university 
community but that orientation is extended to encompass concern for 
other aspects of the social system especially public schools and pro- 
fessional associations. 

1. Impact on Children; 



O 
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The ultimate criterion for the evaluation of any teacher education 
program designed to prepare personnel to work in elementary schools 
is found in the extent to which personnel trained through it have 
desirable impact on children. However, the experimental design problems 
inherent in any attempt to Implicate a training program for its impact 
on trainees, which in turn must be translated to children and reflected 
by then^ are monximental. Attempts to assess the differential impact of 
different types of programs on the trainees alone are beyond the scope 
of most attempts at evaluation. To presume that minute differences (if 
any) in trainee profit from different treatments will be translated in 
turn to children whom they encounter is at present only theorectically 
possible if other than the most mundane behavioral outcomes are sought. 
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Yet attempts must be made to that end if an adequate tech- 
nology of evaluation is to be developed. Data are presented in 
this section primarily to illustrate some of the Inherent problems. 

The data also provide some qualified indications of the well being 
of children within the training setting, but this should not be used 
to imply that all the trainees have proven themselves competent to 
promote the same outcomes from children encountered in other settings. 
The latter type of inference would require data 'drawn in a multi- 
variate analysis of several hundred settings (such as the one setting 
illuminated in appendix G). The conclusions from any such study 
would be questionable, at best, when the problems Inherent in evalu- 
ating programs for the disadvantaged are consiv.ered. Hopefully the 
narative which follows will illuminate some of those problems by 
looking at data on the self concepts and achievement of special and 
more typical children at a training setting. 

a. Self-Concept: 

Self-concept is a hypothetical construct about which much 
has been conjectured and written. But as Combs and Soper^ noted: 

"Tli» self as a discrete entity does not exist." Therefore, it 
cannot be measured directly. Assessment can only be made through 
Inference. Inferences can be made from self-reports (paper and 
pencil tests), teacher ratings (behavior checklists), and/or more 
informal perceptions by observers. Data which will be cited here 
were drawn primarily through two sources. Those were (1) the 
Coopersmith "Self-Esteem Inventory"^ and (2) an adaptation of the 
FitzGibbon "Rating Scale for Measuring a Child's Self Concept" 

(see appendix L for a copy). 

Two types of Instruments (one self-report and one teacher rating) 
were chosen in order that scores from one could be used to validate 
Inferences made from scores drawn by the other and to provide a 
broad base of data by 'lich to test hypotheses about one of the several 
factors which should be considered in self-concept assessment. Parti- 
cular interest was centered on the fact that statistically significant 
correlations between self-report and teacher rating scores had not been 
found in published literature, nor in the author's previous attempts 
to find relationships between the two measures. 



^Combs, A.W., and D.W. Soper. "The self, its derivative terms, and 

research," Journal of Individual Psychology . Vol. 13, 1957, p. 136. 

o 

Coopersmith, Stanley, The Antecedents of Self-Esteem . W. H. Freeman 
and Company, 1967, pp. 265-266. 
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....there is no significant relation between the 
inferred self concept (from racings) of these children 
and self reports.... The results of this study appear 
to support the theoretical position that (rated) self 
concept and self report are quite different conceptions. 

Though they may bear some relationships to each other 
they are certainly not to be used interchangeably as 
personality measures.^ 

These facts have placed the validity of self-report measures 
of self-concept in serious question. Because of this it seemed 
unwise to attempt to infer level of sc!f-concept from only one type 
of measure, and further attempts to resolve reasons for lack of 
congruence between measures seemed to be in order. This author 
attempted to do this by further exploration of his hypothesis 
about the confounding influence of defensiveness in the assessment 
of self-concept through self-report measures. 

The Ccopersmith Self-Esteem Inventory (SEI) was selected 
as the self-report measure after dissatisfaction was experienced 
with other similar measures during previous years. The SEI also 
offered an opportunity to monitor defensiveness with eight abso- 
lute statements (e.g. "I never worry about anything," **I always do 
the right thing," or "I*m never unhappy"), which formed an integral 
part of the te$t format. 

The FitzGibbon Rating Scales (FRS) was selected as the teacher 
rating format because of its relative freedom from cultural bias. 

Less acceptable scales tend to focus on the importantance of middle 
class values (i.e.jthey include items like - "Keeps self well-groomed," 
"Does not waste ti&e," or "Evidences strong pleasure in good work."), 
Coopersmith^ has provided a behavior rating form to accompany his SEI, 
but preliminary use of his two instruments concurrently failed to produce 
scores which he’d a statistically significant amount of variance in 
common. Therefore, data drawn by pretest and posttest with the SEI was 
paired with teacher and aide ratings derived with the FRS. Correlations 
between scores derived concurrently from the two measures are depicted 
in Table I. 



^Combs, A.W., D.W. Soper, and C.C. Courson. "The measurement of self- 

concept and self-report," Educational and Psychological Measurement . 

Vol. 23, 1963, p. 498. 

^Arneklev, B, L. "The use of defensiveness as a covariate of self-report 
in the assessment of self-concept among Navajo adolescents." 

(Unpublished Ed.D. dissertation, Utah State University, Logan, Ut., 1970). 

5ibid. The antecedents of Self-Esteem . W.H. Freenan and Company, 

1967, pp. 267-268. 
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TABLE I 

Correlations Between Scores Derived Concurrently 
from the Coopersraith Self-Esteem Inventory (SEI) 
and the FitzGibbon Rating Scale (FRS) for Measuring 
a Child's Self-Concept 



FRS 



Grade 4 


SEI 


Pretest 


.14 


.50** 


(N=28) 


Posttest 


.43* 


.43* 


Grade 5 


SEI 


Pretest 


.56** 


.40* 


(N=25) 


Posttest 


.33 


.40* 


Grade 6 


SEI 


Pretest 


.66** 


.50** 


(N=27) 


Posttest 


.61** 


.48* 


Grades 


SEI 


Pretest 


.46** 


.50** 


4,5, & 6 
Comb Ined 


Post test 


.45** 


.45** 




(N=80) 










*P ,c *05 


(This 


correlation 


would have 


occurred by 



chance less than five times in one hundred.) 

.01 (This correlation would have occurred by 
chance less than one time in one hundred.) 



From Table I it may be seen that statistically significant 
correlations were found in fourteen out of the sixteen instances and 
that the majority of the correlations were significant beyond the .01 
level. These correlations, though accounting for less than 44 percent 
of the variance in any one case, are the first substantial evidence of 
concurrent validity between self-report and teacher rating methods used 
to achieve scores for the inference of self-concept. The magnitude of 
the correlations was equal to or greater than correlations commonly 
reported between different self-report measures of self-concept. 

Some speculation is in order as to why correlations between the 
SEI and FRS were unusually high. One contributing factor appears to 
be the heterogeneous nature of the classes, i.e., that handicapped 
children were integrated into the regular setting extending the range 
scores on the two measures. This is not always empirically predictable 
because disadvantaged children could and often do score as well or better 
than more typical children on self-report measures. Data relevant to 

this consideration are depicted in Table II. 




Soares, Anthony R., and Louise M. Soares, "Self-perception of culturally 
disadvantaged children," American Ed ucation Research Journal, 1969, 

6, 31-44. 

Powers, Jerry M. et al, "A research note on the self-perception of youth, 
American Education Research Journal , 1971, 8, 665-670. 
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TABLK II 

Analyses of Variance 

of the Difference Between SEI and FRS Scores 
Attained by Special Education Students as Compared to 
More Typical Students 







More 


Special 






Instru- 




Typical x 


Education x 


Average 


(F) Level of 


ment 


Occasion 


Score (N®71) 


Score (N=9) 


Difference 


Significance 


SEI 


Pretest 


37.1 


25.4 


11.7 


27.19*** 




Posttest 


39.7 


26.6 


13.1 


30.54*** 


FRS 


Pretest 


64.4 


42.0 


22.4 


20.86*** 




Posttest 


73.7 


49.9 


23.8 


22. 90*** 



***p < .001 (This difference would have occurred by chance less than 

one time in one thousand.) 



From. Table II it may be seen that on the pretest and posttest with 
both the SEI and the FRS the scores attained by special students are 
s ig^iif icantly different from the scores of more typical students at well 
beyond the .001 level. These are consistent with the theories about 
depressed self-concepts among the disadvantaged and tend to promote 
acceptance of the data as valid. However, these data are not presented 
only to make that point (as inviting as that temptation may be). 

The important finding to be drawn from this data is that it contributed 
to higher correlations between scales by extending the range of scores 
on both indices in a consistent manner. That conclusion can be substantiated 
by data in Table III. 



TABLE III 

Correlations Between Scores Derived Concurrently 
from the SEI and FRS with and without 
Special Education Students in the Population 




FRS 









Pretest 


Posttest 


Grades 4^5, 6e 6 










Combined (N=80) 


SEI 


Pretest 


.46** 


.50** 


Including Spec. Ed. 




Posttest 


.45** 


.45** 


Grades 4^5 , 6e 6 










Combined (N=71) 


SEI 


Pretest 


.35** 


.38** 


Excluding Spec. Ed. 




Posttest 


,33** 


.34** 


Grades 4^5, 6e 6 










Combined (N=9) 


SEI 


Pretest 


.13 


.08 


Special Ed. Only 




Posttest 


-.23 


-.21 



jne time in one hundred.) 
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From Table III it may be seen that removing the scores of 
special education students from the population reduced the common 
variance accounted for by the two Instrviments by approximately ten 
percent in all cases. The correlations remained significant at 
’ eyond the .01 level, but the magnitude of correlations was markedly 
reduced. From this it may be concluded that heterogeity within the 
target population contributed to indications of concurrent validity 
between the SEI and FRS. 

A second factor which probably contributed to indications of 
validity was the suming of two ratings made independently 
by the participating teacher and aide for evciy student in each 
classroom. This could tend to reduce the attenuation of correlations 
due to spuriously high or low ratings. The extent to which the FRS 
and situational factors contributed to reliability are, or course, 
related to that. Data indicating FRS interrater reliability are 
depicted in Table IV. 



TABLE IV 



Correlations Indicative of Interrater Reliability 











Grades 


Grades 


Spec. Ed. 




Grade 4 


Grade 5 


Grade 6 


4,5, & 6 


4,5, & 6 


Only 




(N=28) 


(N=25) 


(N=27) 


(¥-80) 


Less Spec. 
Ed. (N=71) 


(N«9) 


Pretest 


Rating 


.83 


.83 


.91 


.85 


.81 


.83 


Posttest 


Rating 


.78 


.8-^ 


.69 


.77 


.72 


.77 



From Table IV it may be seen that interrated reliability was 
moderately high in all cases. This indicates that raters were able to 
conceptualize and rate the characteristics of students with an accept- 
able degree of reliability by using the FRS. 

A third factor which probably contributed to the indications 
of self-concept measure validity was the extent to which test-retest 
reliability was maintained between pretest and posttest on the SEI 
and FRS. Data indicative of that are depicted in Table V. 
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TABLE V 



Correlations Indicative of (8 month) Test - Retest 
Reliability of the SEI and FRS** 





Instru- 


Grade 4 


Grade 3 


Grade 6 


4,5,6 


• 

4,5,6 


Spec. Ed. 




ment 


(N=28X 


(N=25) 


(N=27) 


(N=80) 


Less 

Spec. Ed. 
(N=71) 


Only 

(N=9) 


Correlation 


between pre- 


SEI 


.67 


.74 


.88 


.75 


.63 


.88 


and post- 


test scores 


FRS 


.51 


.75 


.88 


.68 


.58 


_tZ5 



**A11 correlations are significant at or beyond the .01 lev--*.!. 



From Table 7 it may be seen that test - retest correlations were 
moderately high in all cases. This is of particular note in light 
of the eight month period of time between pretest and posttest scores 
from which the correlations were calculated. (The tendency of corre- 
lations to increase with grade level may also be of some significance 
as an indicator of the extent to which the pupils were becoming more 
crystalized in thought and behavior.) These data provide 
evidence of a third factor which has contributed to indications of 
validity manifested by the SEI and FRS intercorrelations. 

The factors discussed above as contributors to indications of 
validity should accomodate the understanding of why an uncommon 
finding (significant correlations between scores concurrently de- 
rived by the SEI and FRS.) arose. Their occurence was probably 
necessary in bringing about a desired outcome. If they can be moni- 
tored and replicated with similar findings a greater acceptance of 
these criterion leasures of self-concept would be possible. 

Assuming these measures are valid, what do they tell us about 
the impact of the training program on special and more typical 
children at the laboratory school? 

(1) Special Children; 

On the basis of data reported in Table II it was noted that 
special children were significantly lower in self-esteem as measured by 
self-report, as well as significantly lower in self-concept as 
measured by teacher ratings. The question of what happened to them 
during the course of this year in the project then arises. Data in 
Table VI are presented in answer to that question. 
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TABLE VI 



Self-Esteem and Self-Concept Progress 
of Special Education Students (N=9) while Integrated 
Into the Regular Classroom at the Training Site 





X Pretest x 
Score 


Posttest 

Score 


Average 

Gain 


(F) Level of 
Significance 


SEI 


25.4 


26.6 


1.2 


.09 n.s. 


SEI 


(Defensiveness) 2.89 


1.33 


-2.56 


2.10 n.s. 


FRS 


42.0 


49.3 


7.9 


1.49 n.s. 



n.s.= not significantly different froii zero. 




From Table VI It may be seen that although the special edu- 
cation children who were Integrated In the regular classroom 
attained higher self-esteem and self-concept scores at the end of 
the year than at the beginning, the difference was not statistically 
significant. Also, scores for defensiveness were lower on the average 
at the end of the year than at the beginning, but not to a statisti- 
cally significant degree. All three of these changes were In the 
desired direction. Indicating equal or higher f elf-concepts. The 
small number In the sample makes the attainment of statistical signi- 
ficance unlikely. From Table VI It may be concluded that Integration 
In the regular classroom at the training setting was not detrimental 
to the self-concepts of special children as a group. 

(2) More Typical Children: 

When special chilutren are Integrated into the regular classroom 
they make substantial demands on the time and energies of teachers and 
fellow students. The question arises as to whether those demands de- 
tract from the extent to which the needs of more typical children are 
being met. Table VII reflects data relative to the self-concept status 
of more typical children at the beginning and end of the project year. 

TABLE VII 

Self-Esteem and Self-Concept Progress 
of More Typical Children (N=71) while 
Integrated with Special Education Children 



at the Training Site 





X Pretest 


X Posttest 


Average 


(F) Level of 




Score 


Score 


Gain 


Significance 


SEI 


36.1 


39.7 


3.6 


5a92* 


SEI 


(Defensiveness) 2.42 


2.15 


CM 

• 

1 


• 7 1 n • s • 


FRS 


64.4 


73.7 


9.3 


15.59*** 



*p< .05 
***p c. *001 
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From Table VII it may be seen that the self-concepts of 
more typical children were significantly higher as measured by 
self-report and teacher rating methods. The groups tended to 
be less defensive on the posttest, making the self-report gains 
even more noteworthy, 

(3) Conclusions on Self-Concept Assessment: 

Whether or not self-concept Instruments serve to derive 
valid scores from which to infer self-concept is a crucial question. 

Data to substantiate their validity are sorely needed. Data were 
derived and reported here that indicate concurrent validity between 
a self-report and a teacher rating method of attaining scores from 
which to infer self-concept. Heterogeneity in the target population, 
and moderately high indications of interrater and test - retest re- 
liability where cited as contributors to indications of concurrent 
validity, 

Evider :e of enhanced levels of self-esteem and self-concept 
were found in the special and more typical children at the end of 
the project year. The concurrence of findings indicative of this 
on Independent measures in the context of equal or ’ess defensive- 
ness on the part of pupils is viewed as most encouraging, 

b. Achievement: 

Serious questions are prevalent about the appropriateness 
as well as the validity of various measures which proportedly measure 
levels of achievement in school. These questions are particularly 
pointed for those who advocate assessment of pupil progress as a 
criterion by which to evaluate programs and remunerate educators. 

Here again is a place at which theoretical notions far exceed the 
practical possibilities. A great deal of study is needed to define 
where various t Iterion measures are appropriate and what their limi- 
tations are. The remarks and data presented in this section on achievement 
are directed primarily to that end. 

The primary tool used to assess achievement was the Metropolitan 
Achlevanent Tests (MAT). These tests had been used each spring in 
previous years and afforded an opportunity to gain a historical per- 
spective on each child. The previous years scores for individuals were 
used as a point from which to measure growth. In this way growth in 
any one particular year can be compared with gain in other years in order 
to gage a picture of test score achievement over an extended period of time. 

During the previous project year the amount of gain assessed in 
a more traditional pretest in the fall and posttest in the spring design 
was compared to the amount of gain assessed in the design mentioned 
above. That comparison indicated that fall to spring designs may in- 
flate the amount of gain actually achieved in any one year, because they 
fail to consider regression effects that may occur during the summer. 
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To test this hypothesis one class was retested in the fall with the 
same instrument that had been used during the previous splng. Find- 
ings were that children as a group tested lower in the fall in 
virtually every area, but not to a statistically significant degree, 
-he average loss on the total battery was two tenths of a grade 
level. Highest losses (of approximately one half year) were found in 
language mechanics and arithmetic computation, while the smallest 
losses (some small gains) were made in the area of reading. These 
findings indicate th->t gains reflected in the following tables on 
achievement are probably conservative as compared to gains Indicated 
in more traditional pretest to posttest designs. 

In all cases achievement data for special education children 
will be presented separately from that of more typical children. 

Table VIII is used to depict differences between those two groups. 



TABLE VIII 



Analyses of Variance of the Difference 
Between Grade Equivalent (GE) Achievement Scores attained 
by Special and More Typical Children (Grades 4.5. & 6) 



Subject 


Occasion 


More 


Special 


V* 

GE 


(F) Level of 


Area 




Typical 


Education 


Difference 


Significance 






(N=71) 


(N=9) 




Word 


Pretest 


6.00 


4.11 


1.89 


7.52** 


Knowledge 


Fosttest 


7.37 


5.22 


2.15 


7 . 33** 


Reading 


Pretest 


5.95 


4.48 


1.47 


3.98* 




Fosttest 


7.24 


4.74 


2.50 


10.32** 


Arithmetic 


Pretest 


5.02 


3.77 


1.25 


9.23** 




Fosttest 


6.13 


4.72 


1.41 


8.12** 



*p < .05 
**P< *01 




(1) Special Children; 

From Table VIII it may be seen that those children who had been 
identified for special education were significantly retarded in aca- 
demic areas. The average scores presented are a reflection of the 
extent to which individuals from either group Interacted effectively 
with the achievement measures. Achievement in the level indicated for 
each of the two groups is a reflection of different factors. In the 
more typical group the score is probably a relatively accurate picture 
of achievement level whereas in the special education group the score 
is more a representation of the ability to read and comprehend in- 
structions. This conclusion is increasingly apparent when the scores of 
special education children below the fourth grade are studied over a 
period of time. Until the child learns to read, the score he achieves 
remains at approximately the same level. That level is attained by 
more or less randomly marking items. 

26 
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table IX 



Analyses of Variance of Achievement Gains 
Made by Special Education Students (N°9) 



Subject Area 


X Fosttest 
Score 


X Pretest 
Score 


Average Grade 
Equivalent Gain 


(F) Level of 
Significance 


Word Knowledge 


5.22 


4.11 


1.11 


1.09 n.s. 


Reading 


4.74 


4.48 


.26 


•06 n«s« 


Arithmetic 


4.72 


3.77 


-95 


2.62 n.s. 



n.s.= not significantly different from zero. 



From Table IX it may be seen that gains of approximately a year 
were attained on achievement tests in word knowledge and arithmetic. 
These gains did not reach statistical significance because of the 
small number in the group and some variability in score changes between 
individuals. The smallest gain in the area of reading might prompt 
a reader to say that more emphasis should be put on the teaching of 
reading. There is a presumption that if the person can be taught to 
perform more adequately on the test, he will be a better reader. 

This begs the question of what performance on the test has to do with 
functioning outside of school. The author can*t help but speculate 
that the current emphasis on the 'need to read' has been generated 
to a large extent by the accountability advocate's 'need to test'. 
Whether by design or default, the special child's problen is increased 
by Insistence th&c he perform in standardized ways. (Further evidence 
indicative of the inappropriativeness of the MAT reading section for 
special students is tt.'ifered in appendix G.) 



TABLE X 



Analyses of Variance of Achievement Gains 
Made by More Typical Students (N=71) 



Subject Area 


Fosttest 

Score 


Pretest 

Score 


Average Grade 
Equivalent Gains 


(F) Level of 
Significance 


Word Knowledge 


7.37 


6.00 


1.37 


15.37*** 


Reading 


7.24 


5.95 


1.29 


13.08*** 


Arithmetic 


6.13 


5.02 


1.11 


26.01*** 


***p< .001 
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(2) More Typical Children: 

From Table X it may be seen that more typical students on 
the average gained more than one year in all areas between the 
spring of the previous year and the spring of the current year. 

The magnitude of these scores and gains are restricted by ceilings 
on the tests which preclude some students from attaining gains. 

In spite of that limitation^ the data are indicative of favorable 
progress by more typical students in a context in which handicapped 
children have been Integrated and a training program is in progress. 
More definitive types of data are depicted in cables XI through XV. 
These tables contain average Grade Equivalent (GE) and Average Grade 
Equivalent Gain (GEG) attained on the Metropolitan Achievement Tests 
by all of the more typical children who han been at the laboratory 
school since the first grade, or for three or more years if they were 
in upper grades. 



INSERT TABLES XI HI XIII XIV & XV 



From the "average composite GEG,.," figures listed at the 
bottom of each of Tables XI through XV it may be seen that pro- 
gress of more typical children has been relatively constant since 
the inception of the EPDA Project in 1969. These tables afford the 
opportunity to look horizontally at a class to compare its progress 
and standing in succeeding years or to look vertically to see how 
its standing and progress compares with other classes during a 
comparable year. 

As was noted in previous annual reports, these average GE and 
GEG scores reflect some variability in the achievement of children 
between grade level and subject matter area. These variations could be 
caused by several fact- :s which should be considered when achievement 
test results are used to evaluate programs. Some of those factors are: 

1. number and type of handicapped children in a particular classroom. 

2. number and type of more typical children in a particular classroom. 

3. emotional and physical stability of trainees in a particular 
classroom. 

4. Interests and abilities of trainees in a particular classroom. 

5. variations in emphasis toward relevant aspects of curriculum by 
various levels of the Metropolitan Achievement Test. 

6. appropriateness of test content (e.g. , arithmetic sub-tests are 
outdated, but have been retained for the contextual data which 
are available in other areas where the content sampled is more 
representative) . 

7. ceilings on achievement tests restricting the reported gains of 
some students. 

8. the degree to which many children in the laboratory school are 
significantly above or below their grade level placement. 

9. various types of curricula utilized in varying degrees in 
different classrooms. 
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TABLE XI 

Composite (Reading^Word Knowledge, & Arithmetic) Achievement 
Grade Equivalent (GE) and Grade Equivalent Gain (GEG) 

By Grade Level (Horizontal) and Year (Diagonal) 
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TABLE XII 
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Reading 

Grade Equivalent (GB) and G^rade Equivalent ^in (GEG) 
By Grade Level (Horizontal) and Year (Diagonal) 
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TABLE XIll 

Grade Equivalent (GE) and Grade Equivalent Gain (GBG) 
By Grade Level (Horlsontal) a.nd Year (Diagonal) 
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TABIE XIV 
Arlthmttle* 

grade Equivalent (GE) and Grade Equivalent gain (GBG) 
By Grade Level (Horizontal) and Year (Diagonal) 





32 ^ ^ 



Grade Placement 1971-*72 
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TABLE XV 
Spelling 

Grade Equivalent (GE) and Grade Equivalent Gain (GEG) 
By Grade Level (Horizontal) and Year (Diagonal) 
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10. proficiency of different master teachers in using various 
curriculum methods. 

11. commitment of different master teachers to using various 
curriculum methods. 

12. distraction imposed by the project in requiring some master 
teachers to be out of the classroom for various reasons (e.g., 
meetings and/or follow-up visits) . 

13. the interaction of any or all of the factors listed above. 

O 

Attempts to control some of these factors are noteable®. But 
it is hazardous to generalize from group test data because of the 
myraid of factors that come into play in the assessment of the value of 
any one teaching act with any one child. The most significant in- 
formation pertaining to any achievement score is why the child attained 
what he did. Unfortunately that information can generally only be 
reached through speculation from individual test scores and is lost 
in descriptive statistics. 

(3) Conclusions or. Achievement Assessment: 

Scores of special education students are often low on standard” 
ized achievement tests. The group involved in this project fit that 
part of the typical operational definition. However, they completed 
achievement tests and demonstrated respectable test gains. The mean- 
ing of those test indications of gain are questionable, especially in 
cases where limited reading ability was a factor. 

More typical children attained test scores of gain greater than 
one grade equivalent in all areas as a group. Yet, fluctuations within 
and between groups and subject areas make Implications less clear. 

The only reasonable conclusion seems to be that academically the children 
are doing as well or better than ever in a training setting in which 
special education children have been integrated into the regular classroom. 



o 

St. John, Nancy, "Thirty-Six Teachers: their characteristics and 

outcomes for black and white pupils," American Educational Research 
Journal. Vol. 8, #4 November 1971, pp. 635-648. 
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2. Impact on Trainees: 

When the proposal was written the primary concerns for 
assessment were focused on trainees and their progress. Thus, 
performance objectives were directed to that end. Those ob- 
jectives will be used here as an outline. Summaries of data 
and discussion about the practical significance of findings will 
be advanced within the context of each objective. 

a. Performance Objectives: 

1. Objective one: Trainees (experienced teachers and in- 

structional aides) in the EPDA Project will develop 
increasingly positive values (the connotative, emotional 
and/or affective aspect of attitudes) toward working with 
exceptional children in the regular classroom, team teach- 
ing , teacher aides, changes in methods of education, 
parental involvement, and community control as measured 

by semantic differentials. 

2. Objective two: Trainees will develop increasingly 

positive beliefs (the denotative rational and/or cognitive 
aspect of attitudes) about the reasonableness of educating 
exceptional children in the regular classroom, team teach- 
ing, teacher aides, changes in methods of education, parental 
involvement, and community control as measured by semantic 
differentials. 

Objectives one and two will be considered together Inasmuch as 
assessment for the criterion specified in each objective was made by 
using two separate sub-scales of one Instrtjment (see appendix B for 
a copy, and elr/ oration about the Ittst.rument, which was developed by 
the author). Also, because the magnitude of scores on the two scales, 
rating the same theme tended to be comparable (correlations ranged from 
.61-. 96, with a median of .85). Together, the two scores (affective 
and cognitive) can be interpreted as indicative of the general level 
of enthusiasm held by trainees for themes stressed during training. 

Scores attained by different groups (teachers or aides at 
different training periods, or between teacher and aide groups) 
tended to be comparable; therefore, groups will be combined in the 
table which follows. Interim testing between pretests and posttests 
tended not to reflect statistically significant changes; therefore. 
Interim scores are not reported here. Data relevant to objectives one 
and two are presented in Table XVI. 
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TABLE XVI 



Analyses of Variance of Changes in 
Affective (A) and Cognitive (C) Aspects of 
Trainee Attitudes 

Toward Themes Emphasized in the Project 
(N=31) 







Pretest 


Posttest 


Average 


(F) Level Of 


Themes 


Aspects 


*S core 


^ Score 


Gain 


Significance 


Educating 
Exceptional 
Children In 


A 


34.4 


38.5 


4.1 


4.38* 


the regular 
classroom 


C 


35.0 


38.9 


3.9 


4.25* 


Team 


A 


39.8 


40.2 


.4 


.08 


Teaching 


C 


40.1 


39.6 


-.5 


.13 


Teacher 


A 


41.3 


41.2 


-.1 


.01 


Aides 


C 


41.1 


40.5 


-.6 


.23 


Changes In 
Methods of 


A 


38.2 


39.6 


1.4 


1.03 


Education 


C 


39.2 


39.5 


.3 


.05 


Community 
Control of 


A 


27.5 


31.2 


3.7 


2„14 


Schools 


C 


26.9 


32.3 


5.4 


5.12* 


Parental 

Involvement 


A 


36.6 


38.6 


2.0 


.84 


In the 
classroom 


C 


36.5 


39.1 


2.6 


1.98 


*An F of 4.00 


Is required to be significant at 


the .05 


level with 1/60 



degree of freedom; therefore, all F levels identified with an asterisk 
would have occurred by chance less than five times in one hundred. 
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From Table XVI it may be seen that the magnitude and con- 
sistency of gains between pretest and posttest within the treatment 
group reached statistical significance in three instances. These 
were the affective and cognitive aspects of attitude toward "Edu- 
cating Exceptional Children in the regular classroom" and the 
cognitive aspects of attitude toward "Community Contro 1 of Schools." 

From these data one may conclude that objectives one and two were 
partially achieved. 

The lowest pretest and posttest scores (least enthusiasm, but 
still more positive than neutral) were attained in the area of 
"Community Control of the Schools." Tnese scores reflect much of 
the ambivalence that was expressed in response to this section of 
the instrument. Very few of the trainees had been confronted with 
that issue before arriving at the project. They asked questions 
about what it meant on the pretest as well as on the posttest. 

Others expressed the idea that people with professional training 
were in the best position to know what was best for children in the 
schools. The fact that the variance of scores on this theme was 
generally from two to four times as great as it was in other areas 
tends to substantiate a conclusion of less trainee understanding of 
the rationale for community control. 

The most noteworthy indication derivable from Table XVI is the 
relative stability of scores from pretest to posttest. Also, the 
scores represent an indication of relative enthusiasm toward the 
thanes stressed by the project (a neutral attitude would be repre- 
sented by a score of 24, while the highest possible score is 44). 

In several instances subjects attained the highest possible score 
on the pretest and in that way were restricted from showing any gain. 
Maintenance of these positive scores in the context of exposure to 
many new and challenging experiences, regression effects, and un- 
certainty as to usefullness of preparation away from the training 
context is encouraging. 

The scores also ^reflect a possible selection factor in the type 
of personnel (highly enthusiastic) who arrived at the project for 
training. Whether the project would be as successful with a less 
enthusiastic, randomly selected group is questionable. At least the 
possibility of screening for enthusiasm should be raised as a consideration 
when trainees are to be selected for a comparable program. 

3. Objective three: The-self-concepts of trainees will become 

higher (P. is less than .05) through EPDA Project, as measured 
by pre and post project tests with the Tennessee Self Concept 
Scale (TSCS). 

Openness to criticism has been found to be an important con- 
founder of self-report scores of self-concept (see appendix C for 
further discussion). The TSCS assesses that dimension on a scale 
of items Independent from those used to assess self-concept. Summary 
statistics on scores for inference of trainee self-concept and openness 
to criticism are presented in Table XVII. 
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TABLE XVII 

Mean Self-Concept and Self-Criticism Scores 



(N°31) 





S Pretest 


X Posttest 


Ga in 


*(F) Level of 




Score 


Score 




Significance 


Self-Concept 


354.2 


358.5 


4.3 


2.68 


Self-Criticism 


32.1 


31.8 


-.3 


.04 



*An F of 4.00 is required to be significant at the .05 level 
with 1/60 degrees of freedom; therefore, none of the score 
changes noted in this table would have occurred by chance less 
than five times out of one hundred. 



From Table XVII it may be seen that the gain in self-report 
of self-concept was nol; statistically greater than zero. Also, it 
may be seen that the change in mean score from pretest to posttest 
on the self-criticism scale was close to zero. From this one may 
conclude that objective three was not attained. However, some ob- 
servations are in order for further interpretation of data gleaned 
through the TSCS. 

(1) The average pretest and posttest scores depicted fall at 
approximately the sixtieth percentile on published norms. 

(2) Scores on the pretest ranged from 242 (which is less than the 
first percentile) to 418 (which is greater than the ninety- 
ninth percentile) . 

(3) The extent to which scores tended to fluctuate within and be- 
tween individuals is probably of greatest significance. Those 
fluctuations were masked in statistical manipulations; however, 
the inverse relationship between self-report scores for openness 
to criticism and self-concept is a phenomena that appeared on a 
regular basis, especially when people with less academic sophisti- 
cation were considered. Correlations between the two scales were 
-.39 and -.38 respectively on pretests and posttests of trainees 
during the current year. This indicated that as people became more 
open to self-criticism their self-report scores for self-concept 
tended to decline, and vice versa. 

4. Objective four: Trainees will develop increasingly positive 

values of the child's role in the process of learning, as 
measured monthly by the Minnesota Teachers Attitude Inventory 
(MTAI). 

Gains in MTAI attained by trainees in various groups were similar. 
Magnitude of gains attained at Interim monitoring testing periods did 
not reach statistical significance but were consistently (on a group 
basis) increasingly positive. Table XVIII contains data obtained from 
the MTAI as an indicator of attitude change in the desired direction 
(see appendix D for extended comment on the meaning of MTAI scores). 
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